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Summary 



Two group intelligence tests were given to gifted adolescents in a spe- 
cial residential sunaner program, the Governors School of North Carolina. 
One test, the D 48, is non-verbal and timed while the other, the Terman 
Concept Master Test (CMT), is essentially verbal and is untimed. Both 
tests seemed suitable for these subjects (N m 770 the ^-48, N m 1163 
for the CMT) and gave a wide range of scores. Several items on the D*48 
were found to be badly misplaced in order of difficulty, confirming the 
same observation in other studies. Although many items on the CMT were 
also found to be out or difficulty order, this is less crucial for an 
untimed test. 

An operationally defined index of test carelessness was derived for both 
tests by counting errors made on the first or "easy" half of the items 
for each subject when ranked in order of difficulty. Subjects defined 
as careless on one test were not necessarily careless on the other test, 
although there was an extremely limited range of carelessness scores on 
the D-48 that may have attenuated relationships . 

The careless subject on the D-48 tended to get more items wrong an*- to 
omit fewer items but did not get any fewer right than the careful sub- 
ject. On the CMT the careless subject got more right as well as more 
wrong, and omitted fewer items. 

Subjects who obtained high test scores on the D-48 tended to get fewer 
items wrong, to make fewer careless errors, and to omit fewer items. On 
the CMT, however, the high scoring subject did not show such a strong 
tendency to get fewer wrong but did make even fewer careless errors • 

The CMT comprises two parts, Vocabulary and Analogies; they proved to be 
highly correlated at about the same level reported in the test manual. 

The pattern of intratest correlations as well as the intertest correla- 
tions with the D-48 showed that Analogies may be more similar to the 
D-48 in terms of intellectual functions than is Vocabulary. 

Anxiety as measured by the A scale of the Minnesota Multiphasic Personal- 
ity Inventory (MM?I) was negatively related to intellectual performance 
as predicted. This trend was somewhat stronger for the D-48. No evi- 
dence of curvel inear relationship between A and the test scores was fouud. 

One scale on Gough* s Adjective Check List (ACL) also included as a meas- 
ure of anxiety, Counseling Readiness (Crs), showed a positive relation- 
ship contrary to prediction. This was somewhat more marked for the CMT. 

An ACL scale included as the obverse of anxiety, Self-Confidence (S-Cfd), 
was essentially unrelated to the test scores. 

Impulsiveness as measured by the Psychopathic Deviate (Pd) and Hypomania 
(Ma) scales of the MMPI was negatively related to test scores as predicted 
and positively correlated with careless errors particularly on the CMT • 

The ACL scales for Lability (Lab) and Need Change (Cha) also included as 
impulsivlty measures showed no systematic relationship with test scores. 
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Caution as measured by ACL scales for Self-Control (S-Cn), Need Order 
(Ord), and Need Abasement (Aba) were unrelated to the intelligence tests. 

Three Strong Vocational Interest Blank (SVIB) scales were included as 
measures of verbal interest: Advertising Man (Adv), Lawyer (Law), and 

Author- Journalist (A-J). As predicted, they were uncorrelated with the 
non-verbal D-48, but two of the scales, Law and A-J, were highly posi- 
tively related to the CMT, thus partially confirming this aspect of the 
prediction. 



Introduction 



Problem. Because man's behavior is inherently complex and complicated, 
it is inevitable that it be studied in bits and pieces rather than as a 
whole. Some of the bits and pieces have been studied more intensively 
than others because certain aspects of behavior are more readily ob- 
servable than others or because they have more direct bea * ia 8 on tlie 
practical problems of life. Intelligence is one aspect of behavior that 
has been investigated for both of these reasotw. It is teiatively easy 
even in superficial observation to distinguish a grossly defec j**® h11 

from a normal child and to distinguish a clearly superior child from 
both. A hair century or so of intensive work has produced many psycho 
metric instruments capable of yielding scores affording a practical 
method of assigning persons to positions on a continuum of intelligenc . 
At the same time the assignment to levels of intelligence has obvious 
practical implications in terms of school progress, job capabilities, or 
even in the ordinary business of getting along in the world. 



The utility of intelligence tests and their theoretical relationship to 
the concept of intelligence has had important implications that are well 

summarised in the editor's introduction to a book of readings, Ift . . ft — 

gence and ability : 

We began to know (or to feel that ™e knew) much more about the 
cognitive aspects of the mind than about the affective or . conative . 
This tripartite division, so useful as a means of structuring the 
complexities of the relatively new subject of psychology, came to 
be a handicap as well as a help, since it encouraged the erection 
of walls and the creation of water-tight compartments. It is clear 
now, that it is not only unrealistic but misleading to think of 
man’s intellectual gifts and capabilities purely in cognitive terms. 

(Wiseman, 1967, p. 7) 

It is ironic that Wiseman's compl lints should be underscored and exempli- 
fied by the recent appearance of a major book entitled The £L. 

human intelligence (Guilford, 1967) in which the term personality does 
not even appear in the index. That the affective and conative are ig~ 
nored is shown by the chapter titles appearing in a section of this book 
entitled Implications for psychological theory: Perception and cogni- 

tion, Learning, Retention and recall, and Problem solving and creative 
production. This author thus seems to be perpetuating the traditional 
division of psychological tests and measurement into the separate ru- 
brics of intelligence, personality, interest, and special aptitudes. 



Fortunately there have been at the same time some researchers who have 
been relating personality characteristies-including cognitive functions-- 
to many aspects of human behavior. The extensive factor y » 

R. B. Cattail (1965), for example, has resulted in the identification of 
the second most salient personality dimension as »mor<? intelligent vs. 
’’less intelligent” or "high ’g"' vs. "low ’g' ." The intimate r « lat *° a “ 
ship between personality in general and the aspect of behavior usually 
called Intelligence led H. G. Gough (1953) to refer to a scale on his 
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personality inventory as "a nonintellectual intelligence test," 

Despite this trend, it is still customary to rely almost exclusively on 
intelligence tests to make Judgments as to the basic intelligence of 
students even while acknowledging that such scores may reflect many 
other variables in addition to intelligence per se. It is admitted that 
temporary mood states or illness may lower scores and that favorable 
settings and motivation may increase performance. Background experi- 
ences, particularly those related to socio-eccnomic status and educa- 
tional level, are obviously related to test performance. But relatively 
little work has been done to demonstrate the importance of personality 
characteristics in modifying the nature of intellectual behavior. 

Increased knowledge of the relationships between nonintellective factors 
and performance on tests of intelligence is important for theoretical 
and for practical reasons. Further advances in conceptualisation of 
intelligence ma> come from a greater understanding of the sources of 
variance contributing to test scores, and, psychometrically* it may be 
possible to design better tests of basic intelligence which allow for 
the influence of these sources of variance. 

Three areas that seem particularly likely to show systematic relation- 
ships to scores on tests of intelligence arei (1) anxiety, (2) impul- 
siveness, and (3) verbal interests. 

Relate d Literature * A major contribution to the study of anxiety has 
been made by Sarason and his associates (Sarason, et al, 1960). They 
found consistent negative correlations between scores on standard 
intelligence tests and measures of anxiety. On the other hand, when a 
test task involved caution so that carefulness and methodicality were 
rewarded, the usual relationship was reversed. That is, the IQ level 
was unrelated to test scores, but the high anxiety children earned high 
’'caution 1 ' scores. 

At the college level, it has been shown (Sherriffs and Boomer, 1954) 
that the anxious student is handicapped by a Rights-minus-Wrongs scoring 
formula to the extent of one letter grade. This was true even when 
knowledge of course content was held constant; they were penalised by 
a tendency to omit more items in general, and to omit items even though 
it could be shown that they actually knew the answer • 

In personality testing a clear tendency - r or a negative relationship 
between admission of anxiety symptoms and performance has been demon- 
strated (Gough, 1953). Other studies support these findings. 

A study recently completed by the present writer (Welsh, 1967) indicates 
that students with higher verbal interests perform relatively better on 
verbal intelligence tests than on non-verbal teats. 

The evidence suggests, then, that anxiety, impulsiveness (or caution), 
and verbal interests may be systematically related to intelligence test 
performance. 
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Objectives * For use in follow-up studies of his gifted children '•’erman 
developed a difficult group intelligence test (Terman, 1956)* Because 
of its high ceiling it has been useful in studies of creative adults 
(MacKinnon, et al, 1961) and it has been used in special programs for 
gifted high school students in North Carolina and in Georgia* Instruc- 
tions for ^ this test, the Terman Concept Mastery Test (CMT) , state; 

"Omit those items that you could answer only by pure guess, but answer 
all you think you know, even if you are not quite certain. Do not 
study long over any pair." It is possible that the personality charac- 
teristics found by Sherriffs and Boomer may be applicable here and there 
may be differences in the tendencies of subjects to guess or to omit 
items because they are not sure of the answer or, indeed, not sure of 
themselves. Since the scoring procedures for the CMT involve a Rights- 
minus-Wrongs formula, it is crucial to determine what relationships may 
be contributing to the test scores. 

The question to be asked is whether anxious subjects show a different 
pattern of responses from the non- anxious, specifically whether anxious 
subjects earn lower scores on the number correct and whether they are 
less inclined to guess, that is, they also show fewer incorrect responses. 
A related question is whether impulsive subjects are more inclined to 
guess and show more incorrect answers, and also whether they tend to make 
more errors on easy items than more cautious subjects. 

Another qiestion to be asked is the extent and nature of the relationship 
between verbal interests and scores on the CMT since this test comprises 
for the most part vocabulary and other verbal material. A non-verbal 
test, the D-48 (Black, 1963), given to part of the subjects will help 
clarify the nature of this relationship. 

Thus, the basic objective of this study is to determine the degree to 
which a potentially useful group intelligence test will be affected by 
personality characteristics such as anxiety, impulsiveness or caution, 
and verbal interests. 



Procedure 

General Design . Since the data for the study comprised test scores for 
a large number of subjects on several different variables, intercorrela- 
tion of sets of scores seemed most appropriate and Pearson product- 
moment coefficients of correlation were computed. 

However, there is the possibility that some of the relationships, par 
ticularly with anxiety measures, may be non-linear (see, for example, 
Spielberger and Katsenmeyer, 1959); so scatterplots were constructed and 
examine 1 for non-linearity. 

Item analyses of the intellectual measures were carried out to determine 
the order of difficulty of the individual items. 

Population. Subjects from whom the data employed in this study had been 
obtained are gifted and talented high school students who attended a 
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special residential sumner program. The GwerMr's^ 

Una, (Carnegie Corporation Quarter ^, 1964)ln 1963, 1964, and 
total of 1163 subjects were tested during those summers. 

8 tudents^^T he^ tests Se^alyte^in^wrstu^ (l)T^verttl 

^1 ttohasic^Personali ty T Inventory ; 4 a measure of self-concept Gough's 

Mlective Check Ust; and (5) an interest test, the Strong Vocational 
Interest Blank (the men's form was given to the girls as we 
boys) . 



(1) The D-48 Test 

The n-48 is an American adaption of a non-verbal test developed in its 

- . staff of the Centre de Psychologie Appliqoee In 

present form by *e staff ot tne^ o£ dominoes in which the sub- 

ject'must^disceTO* the°reletionship in each series and fill in the jppro- 
priate** numbers in the last domino, which is blank. No "“g; 

except for reading the instructions, is required r ■ ■ _____ 

Preliminary Manual (Black, 196J; descrio ffe «*ral factor in 

verbal analogies test measuring primarily the g or g 

intelligence” (p. 1)- 

2.*i'^5S’^S'S.”Si2«“USr‘£S 2j*sr '£*£ 

used as -xampxe» lu & Twentv-five minutes are allotted to the 

test proper, which is timed. Twenty 11 - minutes that 10 minutes 

test and subjects are informed at the end of 15 minutes that to m 

remain. The time limit seems ^"^“^“the^ange of difficulty 

the subjects completed al * 0 ,, ect g ot all 0 f the items correct 

proved adequate and none of th j 8 i nM A*t score was only 

although two subjects m-.ssed only one item. The lowest score was on y 

two items correct; thus there was a wide score range of 40 point . 

sssv? Sfattr”' 

aince*he ^ 

The mean score for 770 Governor's School subjects ie 29.55 with a »tand- 
ard deviation of 6.07. These subjects average me--* higher than the l5, 
16, and 17 year old French school children reported in the gssesL 
would be expected. They score almost as high as **e c 8 “ 

and females reported there and at about the same level as 20 24 year old 

French students. 

Cantwell (1966) found a mean of 2 ®*® 7 ’ * S ^®’ a’^^for 1 ” college males 
Lebanese^ollege ^“"sTested by Rafi (1967) fell somewhat lower 
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with a mean of 26.04, S. D. 5.80, for 1167 subjects while a second group 
of 170 showed 25.73 and 5.97. The present writer has used the D-48 in a 
Tests ana measurements course given to advanced undergraduates and grad- 
uates i a mean of 29.67, S. D. 4.87, has been obtained for 85 subjects 
with no apparent difference between undergraduates and graduates. 

The Governor’s School subjects, then, seem to fall at about college 
level in terms of mean score but are somewhat more variable possibly 
because of a few extremely low scores. The skewness of the distribution 
is apparent in Table 1 lere the lowest 10 per cent of the subjects 
ranged from 20 down to two. Summary statistics and cumulative percentages 
are also given in the table. No significant sex differences were found 
in the distribution of scores. 



(2) Terman Concept Mastery Test 

The CMT is an untimed test of 190 items in two parts, Part I contains 
115 word pairs that must be classified as either synonyms or antonyms. 
Part II contains 75 analogies. The original form of the CMT (Form A) 
was devised in 1939 for follow-up studies of the Stanford research with 
gifted subjects and is described in detail by Terman and Oden (1947, 
pp. 125-146). A revised form (previously Form B but now called Form T) 
was prepared in 1950 by eliminating some of the excess top items and 
extending the level downwards so that spouses of the gifted subjects 
might be included in the range of scores (Terman and Oden, 1959, pp. 52 
63). 

Form T has now been published and a Manual (Terman, 1956) describes the 
test, gives directions for administration and scoring, and summarises 
some research findings. The test is, according to the Manual . "a meas- 
ure of the ability to deal with abstract ideas at a high level. It is 
suitable for administration to college juniors and seniors and to grad- 
uate students.” Since the present subjects were especially selected 
high school students of unusual abilities, the CMT seemed an appropriate 
measure of general intellectual ability with an adequate range of possi- 
ble scores. 

The (?:ir Manual suggests that, ” those for whom the test is intended will 
ordinarily complete it within forty minutes.” Most of the students did 
complete t^e test within that time, although a few took a full hour. 

None of the subjects experienced any difficulty in following the direc- 
tions given in the test booklet but some questions were raised about 
guessing. The instructions state, "Omit those items that you could an- 
swer only by pur& guess, but answer all you think you know, even if you 
are not certain.” Apparently some of the students did too much guessing 
since 16 of them received scores below zero. Negative scores are possi- 
ble because wrong answers are penalized: on Part I, Vocabulary, a right- 

minus-wrong (R-W) formula is used, and on Part II, Analogies, the score 
is the number right minus one half the number of wrong answers (R-%W); 
for an odd number of wrongs the .5 is dropped. The total score is the 
sume of the two part scores! with all * terns correct this would be 190 
(115+75) . 
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Table 1 



Distribution of D-48 scores; number of items correct 



Cumulative Percentage 



100.0 

99.8 

98.6 

96.0 

88.6 

78.6 

66.2 

52.6 

39.0 
28.2 

19.7 
11.4 

7.5 

4.0 

2.7 

1.7 

1.0 
.65 
.49 

.26 

.13 



N - 770 
M - 29.55 
SD ■ 6.07 
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Scores Frequency 



43-44 


2 


41-42 


9 


39-40 


20 


37-38 


57 


35-36 


77 


33-34 


95 


31-32 


105 


29-30 


105 


27-28 


83 


25-26 


65 


23-24 


64 


21-22 


30 


19-20 


27 


17-18 


10 


15-16 


8 


13-14 


5 


11-12 


3 


9-10 


1 


7-8 


2 


5-6 


0 


3-4 


1 


1-2 


1 






Table 2 shows the distribution of scores with cumulative percentages and 
IZ Jy statistics for all of the 1163 

161 and the lowest -32, giving a range of 193 “ore P°£““* ™ th “ gh lt 
score falls below all of the ten groups listed In the Manu al altno g 
is equivalent to the lowest group reported, 344 Air Force captains, with 
a mein of 60.1 and a standard deviation of 31.7. The highest groupls, 
of coVrlc. the 1004 subjects of the St f ford gifted 
mean of 136.7 and standard deviation 28.5. Hone the 6 r 

scored below 40 and half of them fell above 141. The spouses of the 
gifted subjects (N - 690) are midway between the extremes 0 f 8““P* 
lllh a mean of 95 .3 but were more variable and had a standard deviation 
of 42.7. xt is of interest that four of the spouses obtained nega 

scores* 

The Manual for the Miller Analogies Test (Miller, 1960) reports orrela- 
tlon^of.73 for two groups of subjects with CMI scores. 
standard deviations on the CM! are given as follows, for 77 | ra £ 8t * 
students in psychology in a western university, 107.7 and 26.2, for 2 7 
graduate students in various departments in a southern university, 53.1 
and 32.4. The present subjects, if compared to subjects 
geographical region , score! somewhat higher than graduate students. On 
the 8 °therhandt more recently the present writer has administered the 

Z tests to sections of a tests and — « ^“Vtics 

undergraduate and graduate students. For N 85 the r g 

were found: 



cm 

D-48 



M 

81.96 

29.67 



SD 

24.41 

4.87 



.24 



The Governor's School subjects fell somewhat below these subjects on the 
CMT although they scored as high on the D-48. 

Terman and Oden (1959) found consistent sex differences in £»oro£ 
males both for the gifted subjects and their spouses V £ffc£ 
means are- 139.4 to 133.4 and 102.6 to 90.5. Although these ditter 

ences are'not marked, statistical significance is shown .l^wenTwith 
ratios of 3.4 and 3.6. The present subjects show a similar trend with 

males “-^^“f^^^rwVrcrVassVs th? .Ooi level of signifi- 
cance .° The differetce ll JL is o/little practical aigniflcance how- 
ever, because the distributions for both sexes have such a wide rang 
and show almost complete overlap in range. 

For the two intelligence tests seven different measures are of interest: 

a. the number of items right— R. 

b. the number of items wrong- -W 

c. the number of items omitted 0 . r 

d. the number of careless errors-C. In this study the order f 
difficulty of the items in both tests was determined by the 
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Table 2 



Distribution of CMT scores: rights minus wrongs 



Scores 



Frequency 



Cumulative Percentage 



160-169 1 

150-159 1 

140-149 7 

130-139 12 

120-129 12 

110-119 21 

100-109 34 

90-99 58 

80-89 86 

70-79 126 

60-69 163 

50-59 169 

40-49 150 

30-39 133 

20-29 35 

10-19 62 

0-9 27 

- 1—10 13 

-11-20 0 

-21-30 2 

-31—40 1 



100.0 
99.91 
99.83 
99.24 
98.2 
97 o2 

95.4 

92.4 

87.4 
80.0 

69.2 

55.2 

40.7 

27.8 

16.3 
9.0 
3.7 
1.4 



.26 

.09 



N * 1163 
M - 56.77 
SD - 28.70 
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total number of subjects getting each item correct. With the 
items arranged in order of difficulty* an index of carelessness 
was defined for each subject as an error in the first or ’'easy” 
half of hij own distribution of correct items. For example, 
suppose a subject attempted 25 items and got 20 of them correct. 
Any incorrect responses on items one through ten would be 
counted as a careless error, but any errors from item 11 on 
would be ordinary errors. 

e. the "corrected” value of rights minus wrongs--R-W. 

f. the number of items attempted, rights plus wrongs — R+W. 

g. the ratio of e. and f.--R-W/R+W. This value was included to 
identify subjects who got proportionately more items correct 
regardless of the absolute number of items correct. 

For consistency in terminology the term "measures" will be understood in 
this report to refer to these seven terms . The term "score" in the case 
of the D-48 will be "R" but for the CMT will be "R-W." It may also be 
noted that for the second part of the CMT, Analogies, the R-W formula 
actually means rights minus one-half wrongs; thus R+W is not exactly 
equivalent to the number attempted. 



(3) The Minnesota Multiphasic Personality Inventory (MMPI) 

The MMPI is an assessment device originally developed for use in medical 
settings but now widely used for general personality research. In its 
standard form the inventory comprises 550 statements which the subject 
marks as either "True or mostly true, as applied to you," or "False or 
mostly false, as applied to you." Although more than 200 special scales 
and scoring indeces have been developed (Dahls trom and Welsh, 1960) there 
are in the standard profile only three "validity" scales and ten "clini- 
cal" scales (Hathaway and McKinley, 1967). Two of these regular scales, 
Pd and Ma, afford measures of impulsivity and a special scale, A (Welsh, 
1956, 1965), is used to assess anxiety. 



(4) The Adjective Check List (ACL) 

The ACL is an assessment device developed by Professor H. G. Gough of 
the University of California at Berkeley that has proved useful in 
inferring the self-concept of a subject by the self-description he pro- 
vices • The ACL comprises 300 adjectives arranged alphabetically from 
"absent-minded" through "aany" in a two-page booklet with the following 
instructions on the face sheet: 

DIRECTIONS: This booklet contains a list of adjectives. Please 

read them quickly and put an X in the box beside each one you 
would consider to be self-descriptive. Do not worry about dupli- 
cations, contradictions, and so forth. Work quickly and do not 
spend too much time on any one adjective. Try to be frank, and 
check those adjectives which describe you as you really are, not 
as you would like to be. 
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The teat Manual (Gough and Heilbrun, 1965) discusses 24 experimental 
scales and indeces that have been developed for use with the ACL. 

Although all of these measures have interesting possibilities in the 
study of personality and intelligence, seven scales were selected for 
use in the present study because they seemed particularly pertinent for 
the dimensions of concern. Impulsivity seems to be related to the scales 
for Lability and Need Change; caution to Self-Control, Need Order, Need 
Abasement; anxiety to Self-Confidence, Counseling Readiness. 



(5) Strong Vocational Interest Blank (SVIR) 

Subjects in the study, both boys and girls, were given the Men's Form of 
the SVIB (Strong, 1959), a well-known and widely used device to assess 
vocational interests. The SVIB comprises 400 items and is ordinarily 
scored for 50 or more scales but only three were utilised in the present 
study. Verbal interest was me isured by scales for Advertising Man, 
Lawyer, and Author-Journalist; these are the Group X scales referred to 
by Darley and Hagenah (1955) as "verbal-linguistic • " There is some evi- 
dence (Welsh, 1967) that among the present subjects those who are high 
in verbal interests tend to score higher on verbal than on non-verbal 
intelligence tests. 



Results 

Intelligence Measures . The difficulty level of the D-48 items was 
determined by tallying the frequency of correct response for each item; 
the frequency of incorrect response and of no response was also recorded. 
These data are given in Table 3 as ,f R" (right), "W" (wrong), and "0" 
(omitted). The range of difficulty fell from item 1, which was answered 
correctly by 765 of the 770 subjects, to item 42, which was answered 
correctly by only 80 of the subjects. 

The difficulty level has also been expressed as a proportion in Table 4 
where the range is from .9935 for item 1 to .1039 for item 42. These 
data are given in the first column headed "T" to indicate that the pro- 
portions are for the total group of subjects . Since varying numbers of 
subjects omitted each item, the difficulty level is also expressed in 
another form by calculating a proportion based on subjects getting an 
item right out of the number of subjects attempting the item. These pro- 
portions are given in column "A." Difficulty level expressed in rank 
order is given in column "RT" for total proportions and in column "RA" 
for proportions correct of those attempting each item. 

It is apparent that the sets of ranks are quite similar; indeed, the 
rank order correlation between RT and RA gives a rho of .9995. On the 
other hand, it should be noted that a few items show some displacement. 
For example, item 44, the last item in the test, is answered correctly 
by only .1234 of the subjects; but of the subjects who had time to 
attempt this item .3558 got it correct. Thus item 44 ranks 43rd in 
difficulty when expressed as a proportion of all subjects but drops to 
38th when expressed as a proportion of those attempting the item. 
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Table 3 



Difficulty level of D-48 items expressed as frequencies 



Item 


R* 


W 


0 


1 . 


765 


4 


1 


2. 


764 


6 


0 


3. 


745 


19 


6 


4. 


755 


14 


1 


5. 


713 


52 


5 


6. 


747 


23 


0 


7. 


668 


95 


7 


8 . 


688 


74 


8 


9. 


661 


92 


17 


10. 


729 


39 


2 


11. 


720 


45 


5 


12. 


734 


32 


4 


13. 


741 


26 


3 


14. 


747 


23 


0 


15. 


704 


63 


3 


16. 


730 


36 


4 


17. 


563 


171 


36 


18. 


596 


148 


26 


19. 


725 


41 


4 


20. 


697 


65 


8 


21. 


675 


91 


4 


22. 


540 


200 


30 



Item 


R 


W 


0 


23. 


486 


254 


30 


24. 


367 


319 


84 


25. 


204 


412 


154 


26. 


198 


485 


87 


27. 


562 


202 


6 


28. 


614 


119 


37 


29. 


551 


214 


5 


30. 


661 


100 


9 


31. 


501 


186 


83 


32. 


360 


320 


90 


33. 


591 


129 


50 


34. 


384 


316 


70 


35. 


271 


321 


178 


36. 


311 


281 


178 


37. 


261 


341 


168 


38. 


104 


355 


311 


39. 


313 


217 


240 


40. 


218 


266 


286 


41. 


108 


359 


303 


42. 


80 


285 


405 


43. 


104 


247 


419 


44. 


95 


172 


503 



N * 770 

* Number of subjects getting item right (R)» wrong (W), or omitting (0) 
it. 
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Table 4 



Difficulty level of D-48 items expressed as proportions 



Item 


T* 


RT 


A 


RA 


Item 


T 


RT 


A 


RA 


1. 


9935 


1 


9948 


1 


23. 


6312 


29 


6568 


29 


2. 


9922 


2 


9922 


2 


24. 


4766 


31 


5350 


32 


3. 


9675 


6 


9751 


4 


25. 


2649 


38 


3312 


39 


4. 


9805 


3 


9818 


3 


26. 


2571 


39 


2899 


41 


5. 


9260 


13 


9320 


13 


27. 


7299 


25 


7356 


25 


6. 


9701 


4.5 


9701 


5.5 


28. 


7974 


21 


8377 


21 


7. 


8675 


18 


8755 


19 


29. 


7156 


26 


7203 


28 


8. 


8935 


16 


9029 


16 


30. 


8584 


19.5 


8686 


20 


9. 


8534 


19.5 


8778 


18 


31. 


6506 


28 


7293 


27 


10. 


9468 


10 


9492 


10 


32. 


4675 


32 


5294 


33 


11. 


9351 


12 


9412 


12 


33. 


7675 


23 


8208 


22 


12. 


9532 


8 


9582 


8 


34. 


4987 


30 


5486 


31 


13. 


9623 


7 


9661 


7 


35. 


3519 


35 


4578 


35 


14. 


9701 


4.5 


9701 


5.5 


36. 


4039 


34 


5253 


34 


15. 


9143 


14 


9179 


14 


37. 


3390 


36 


4336 


37 


16. 


9481 


9 


9530 


9 


38. 


1351 


41.5 


2266 


43 


17. 


7312 


24 


7670 


24 


39. 


4065 


33 


5906 


30 


18. 


7740 


22 


8011 


23 


40. 


2831 


37 


4504 


36 


19. 


9416 


11 


9465 


11 


41. 


1403 


40 


2313 


42 


20. 


9052 


15 


9147 


15 


42. 


1039 


44 


2192 


44 


21. 


8766 


17 


8812 


17 


43. 


1351 


41.5 


2963 


40 


22. 


7013 


27 


7297 


26 


44. 


1234 


43 


3558 


38 



N - 770 



* T * proportion of total group getting item right, RT * rank of item 

in T column, A 9 proportion of those attempting item answering correctly, 
RA * rank of item in A column; decimal point properly preceding each 
proportion has been eliminated. 



Item 42, on the other hand, rank* 44th in both columns. The implication 
of this discrepancy is that there may be some subjects ^o might have 
gained a point in total score had they had time to reach the 
Which seems to be easier than one placed earlier in the sequence of items. 

Item 39 also seems somewhat easier when viewed *-n:.s way since it drops 
in difficulty rank from 33rd to 30th. Three items, however, mould be 
judged more difficult on this basis since their tank is higher in the 
TA column than in the RA column; item 29 drops from 26th to 28th, item 
41 from 40th to 42nd, and item 26 from 39th to 41st. The only ^other 
item showing a rank discrepancy of as much as two ia Uem 3, which »hif 
from 6th to 4th, thus making it seem slightly more difficult when viewed 
as a proportion of subjects attempting it. 

The overall difficulty rank of the items in terms of proportion of total 
subjects is quite similar to that given in the Manu al for grade “ cho °7„ 
subject, reported by Gough and Domino (1962) . The rho between the sets 
of ranks is .940. A comparable order is reported by Rafi (1967) betwe 
college students in Lebanon and the Gough and Domino ranking, 8 
the rho ss .948. Thus, with grade school, high school, and coUege sub 
jects the order of difficulty seems much the same. Several items are 
badly misplaced in the series for all three groups of subjects, Items 
17 and 18 are much more difficult than the items preceding and following 
them. A second cluster of difficult item, may be found in items 24, a, 
and 26. 

Another way of looking at the problem is this: in 

the items should be placed in an absolute order of di £ £icu£ ty f°!L.p n - 
easiest to the hardest. The rank order correlation between the aequen 
tial numbers of the items and their difficulty rank shoul e . > 

with the present subjects rho is only .891, reflecting the misplacement 

of several Items as noted above. 

The implications for a timed test must be stressed again— if a 
works on a more difficult item because of its earlier placement in the 
sequence of items and does not have a chance to solve an easier item 
placed later, he may well be penalired by a point or ^ “ 

fault of his own. In a test like the D-48 with such a ama£1 
deviation, 6.07, a few points would mean a relatively large ™ 
in his standing on the test. In an untimed test like the Terman CMT, 
of course, misplacement in terms of item difficulty would be of less 
Importance from this point of view. 

Table 5 shows the distribution of carelessness scores for the lt 

is apparent that there is a very narrow range of scores since a ^ an ta ® 
most careless subjects made only four errors of this type and there were 
only two such subjects. Indeed, 563 of the 770 subjects got rero scores, 
thus more than 70 per cent did not make any careless errors at all. 

A comparison was made of the 47 most careless subjects who had made two 
or more errors with a matched sample of 47 subjects Who had made no 
errors. The careful subjects were matched for total score, that is, the 
number of items correct on an individual basis rather than by group 
means . The matching was exact for 42 of the subjects While for four of 
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Table 5 



Distribution of carelessness scores (C) on D-48 



Carelessness score 


preauency 


4 

3 

2 


2) 

) 

7) - 47 
) 

38) 


1 


160 


0 


563 


N - 770 
M * .3442 





SD * .4294 
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them it was within one point and within two points for one subject. The 
D-48 statistics are shown in Table 6. 

The mean number of items cort : is, of course, the same for the two 
samples, 24.09, a value somewhat lower than that obtained for the entile 
group of 770 subjects. The slight discrepancy in exact matching for the 
five subjects mentioned above results in a difference of one point in 
the second decimal place of the standard deviation. 

Differences between the means of the samples for the other D-48 measures 
were evaluated by t-tests. The careless subjects got more items wrong 
(t 1.89— close to .05 level for two-tailed test) but omitted fewer items 
(t 2.81 is significant beyond .01 level). The converse of omissions— the 
number attempted— is seen in the R+W column and has an identical t of 
2.81. The ratio of the number correct and the number attempted is shown 
in the B-W/R+W column; although the careless# subjects got proportionally 
fewer items correct of attempted iteros, the means are not significantly 
different (t 1.48). 

The same measures from the CMT scores of the two samples of subjects 
were also obtained and the statistics are displayed in Table 7. None 
of the means showed a significant t. Thus we have no evidence that sub- 
jects defined as careless on one test will show similar characteristics 
on another test of intelligence. 

The difficulty level of the CO items is shown in frequency form in 
Table 8 and in proportions in Table 9. Although some of the items 
seem to be displaced in order of difficulty, this does not have the 
same implications noted above in the case of the D-48 since the CMT is 
untimed. It should be noted in the tables that the great difference 
between Item 115 and item 116 is that the latter item is the first in 
Part 2 of the CMT. 

The distribution of carelessness scores for the CMT is given in Table 10. 
It is apparent that there is a much wider range of scores than for the 
D-48. On that test the highest carelessness score of 4 represents only 
9 per cent of the total number of items (44) , while for the CMT the high- 
est carelessness score of 28 is almost 15 per cent of the 190 items on 
this test. 

The same kind of analysis as that described above was made by comparing 
two samples falling at the extremes of the carelessness distribution. 

It proved, however, more difficult to match subjects for total score 
(in this case the R-W value since the CMT is "corrected") and the samples 
comprise only 32 subjects each despite the greater number of subjects 
who had taken the CMT. One of the pairs differed by four points, two by 
three, one by two, sixteen by one, and twelve had identical R-W scores. 

The careful subjects had C scores ranging from 0 to 5 and the careless 
subjects fell from 13 to the most extreme score of 28. 

The means and standard deviations for the CMT measures are presented in 
Table 11. All of the measures showed t's far beyond the .001 level of 
significance: R— 11.68, W-10.35, 0-11.90, RW— 11.83, and R-W/R+W- 
4.65. 
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Table 6 



Comparison of careless and careful D-48 subjects on B-48 scores 





R* 


W 


Careless subjects, 
0 C 


N - 47 
R-W 


R-W 


R-W 

R-W 


M 


24.09 


14.85 


5.06 


2.23 


9.23 


38.94 


.252 


SD 


5.46 


6.86 


4.48 


.53 


11.56 


4.48 


.304 








Careful 


subjects. 


N - 47 






M 


24.09 


12.15 


7.77 


0.00 


11.94 


36.23 


.348 


SD 


5.47 


6.86 


4.74 


.00 


11.47 


4.73 


.320 


diff 

in 

M's 


.00 


2.71 


2.71 


2.23 


2.71 


2.71 


.096 


t 


m m 


1.89 


2.81 


28.55 


1.13 


2.81 


1.48 



sig. level for 90 d.f. 

.10 - 1.66 
.05 « 1.99 
.01 * 2.63 



* R~ right, W — wrong , 0- -omitted, C-- carelessness score. 



Table 7 



Comparison of careless and careful D-48 subjects on CMI scores 









Careless 


subjects, 


N » 47 




R-W 




R* 


W 


0 


C 


R-W 


R-W 


R-W 


M 


SX 

90.85 


61.28 


37.87 


6.02 


43.45 


138.26 


.350 


SD 


20.57 


26.46 


38.68 


4.88 


22.69 


35.12 


.198 








Careful 


subjects. 


N - 47 






M 


91.66 


63.06 


35.28 


6.70 


43.43 


139.89 


.320 


SD 


23.31 


25.89 


33.79 


4.90 


30.50 


31.78 


.223 


diff 

in 


.81 


1 .78 


2.59 


.68 


.02 


1.63 


.03 


11*8 
















t 


.18 


.33 


.34 


.67 


.00 


.23 


.69 



sig. level for 90 d.f. 

.10 - 1.66 
.05 - 1.99 
.01 - 2.63 



* R--right, W--wrong, 0--omltted, C— carelessness score. 
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Table 8 



Difficulty level of CMT items expressed as frequencies 



Item R* W 0 



1. 


1151 


11 


1 


2. 


1148 


13 


2 


3. 


1111 


45 


7 


4. 


1083 


79 


1 


5. 


1105 


53 


5 


6. 


1117 


36 


10 


7. 


898 


174 


91 


8* 


1053 


84 


26 


9. 


1071 


82 


10 


10. 


1061 


74 


28 


11. 


1017 


137 


9 


12. 


1091 


55 


17 


13. 


613 


263 


287 


14. 


987 


69 


107 


15. 


889 


179 


95 


16. 


803 


212 


148 


17. 


968 


151 


44 


18 . 


709 


203 


251 


19. 


600 


227 


336 


20. 


760 


346 


57 


21. 


816 


245 


102 


22. 


657 


221 


285 


23. 


827 


182 


154 


24. 


708 


205 


250 


25. 


727 


290 


146 


26. 


583 


183 


392 


27. 


853 


224 


86 


28. 


607 


210 


346 


29. 


713 


253 


197 


30. 


847 


206 


110 


31. 


678 


242 


243 


32. 


554 


240 


369 


33. 


665 


217 


281 


34. 


576 


293 


294 


35. 


739 


253 


171 


36. 


746 


227 


190 


37. 


922 


150 


91 


38. 


1001 


134 


28 


39. 


669 


262 


232 


40. 


304 


267 


592 


41. 


397 


408 


358 


42. 


561 


225 


377 


43. 


612 


284 


267 


44. 


433 


366 


364 



Item 


R 


W 


0 


45. 


687 


315 


161 


46. 


370 


668 


125 


47. 


608 


255 


300 


48. 


395 


404 


364 


49. 


471 


438 


254 


50. 


559 


209 


395 


51. 


407 


281 


475 


52, 


430 


452 


281 


53. 


459 


272 


432 


54. 


374 


588 


201 


55. 


597 


289 


277 


56. 


399 


175 


589 


57. 


401 


287 


475 


58. 


575 


373 


215 


59. 


580 


361 


222 


60. 


431 


423 


309 


61. 


392 


201 


570 


62. 


574 


341 


248 


63. 


260 


628 


275 


64. 


408 


179 


576 


65. 


311 


602 


250 


66. 


372 


230 


561 


67. 


498 


267 


398 


68. 


571 


254 


338 


69. 


546 


380 


237 


70. 


603 


308 


252 


71. 


381 


225 


557 


72. 


424 


458 


231 


73. 


519 


372 


272 


74. 


2 


280 


561 


75. 


334 


249 


580 


76. 


299 


583 


281 


77. 


358 


258 


547 


78. 


495 


284 


384 


79. 


422 


456 


285 


80. 


356 


465 


342 


81. 


314 


312 


537 


82. 


347 


203 


613 


83. 


356 


419 


388 


84. 


266 


511 


386 


85. 


288 


377 


498 


86. 


365 


335 


463 


87, 


377 


308 


478 


88. 


372 


505 


286 
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Table 8 — Continued 



Item 


R 


W 


0 


89. 


360 


257 


546 


90. 


356 


501 


306 


91* 


290 


310 


563 


92. 


342 


252 


569 


93. 


296 


502 


365 


94. 


267 


232 


664 


95. 


342 


321 


500 


96. 


265 


223 


675 


97. 


294 


259 


610 


98. 


368 


173 


622 


99. 


399 


427 


337 


100. 


383 


284 


496 


101. 


291 


599 


273 


102. 


271 


281 


611 


103. 


252 


328 


583 


104. 


205 


475 


483 


105. 


305 


280 


578 


106. 


311 


149 


703 


107. 


262 


662 


239 


108. 


322 


230 


611 


109. 


316 


301 


546 


110. 


240 


354 


569 


111. 


261 


266 


636 


112. 


313 


247 


603 


113. 


202 


495 


466 


114. 


150 


784 


229 


115. 


360 


272 


531 


116. 


1120 


40 


3 


117, 


1090 


72 


1 


118. 


1090 


58 


15 


119. 


1098 


44 


21 


120. 


1116 


45 


2 


121. 


1144 


19 


0 


122. 


1145 


17 


1 


123. 


1128 


33 


2 


124, 


1146 


17 


0 


125. 


1004 


145 


14 


126. 


1058 


80 


25 


127. 


1153 


10 


0 


128. 


1075 


86 


2 


129. 


724 


287 


152 


130. 


853 


292 


18 


131. 


473 


434 


256 


132. 


1074 


83 


6 


133. 


853 


306 


4 


134. 


995 


160 


8 


135. 


768 


353 


42 



Item 


R 


y 


0 


136. 


989 


108 


66 


137. 


964 


154 


45 


138. 


969 


146 


48 


139. 


975 


177 


11 


140. 


811 


284 


68 


141. 


938 


221 


4 


142. 


928 


197 


38 


143. 


721 


398 


44 


144. 


759 


345 


59 


145, 


650 


371 


142 


146. 


892 


205 


66 


147. 


472 


480 


211 


148. 


870 


217 


76 


149. 


838 


278 


47 


150. 


565 


496 


102 


151. 


429 


576 


158 


152. 


714 


351 


98 


153. 


983 


142 


38 


154. 


591 


441 


131 


155. 


572 


379 


212 


156, 


519 


578 


66 


157. 


322 


733 


108 


158. 


862 


218 


83 


139. 


433 


507 


223 


160. 


453 


350 


360 


161. 


477 


461 


225 


162. 


610 


464 


89 


163. 


700 


227 


236 


164. 


142 


530 


491 


165. 


590 


495 


78 


166. 


596 


429 


138 


167. 


577 


491 


95 


168. 


462 


588 


113 


169. 


389 


235 


539 


170. 


471 


543 


149 


171. 


873 


241 


49 


172. 


374 


469 


320 


173. 


144 


865 


154 


174. 


363 


422 


378 


1 ■"’5 . 


720 


415 


28 


i/6. 


246 


605 


312 


177. 


297 


650 


216 


178. 


514 


356 


293 


179. 


344 


390 


429 


180. 


412 


649 


102 


181. 


440 


296 


427 


182. 


179 


506 


478 
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Table 8--Continued 



Item 


R 


W 


0 


183. 


238 


515 


410 


184. 


227 


485 


451 


185. 


245 


778 


140 


186. 


265 


337 


561 


187. 


207 


553 


403 


188. 


237 


718 


208 


189. 


196 


692 


275 


190. 


382 


710 


71 



N * 1163 



* Number of subjects getting item right (R), wrong (W), or omitting (0) 
it. 
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Table 9 



Difficulty level of CMT items expressed as proportions 



Item 


X* 


A 


1. 


9897 


9905 


2. 


9871 


9888 


3. 


9553 


9611 


4. 


9312 


9320 


5. 


9501 


9542 


6 . 


9604 


9688 


7. 


7721 


8377 


8. 


9054 


9261 


9. 


9209 


9289 


10. 


9123 


9348 


11. 


8745 


8813 


12. 


9381 


9520 


13. 


5271 


6998 


14. 


8487 


9347 


15. 


7644 


8324 


16. 


6905 


7911 


17. 


8323 


8651 


18. 


6096 


7774 


19. 


5159 


7255 


20. 


6535 


6872 


21. 


7016 


7691 


22. 


5649 


7483 


23. 


7111 


8196 


24. 


6088 


7755 


25. 


6251 


7148 


26. 


5056 


7626 


27. 


7334 


7920 


28. 


5219 


7430 


29. 


6045 


7381 


30. 


7283 


8044 


31. 


5830 


7370 


32. 


4764 


6977 


33. 


5718 


7540 


34. 


4953 


6628 


35. 


6354 


7450 


36. 


6414 


7667 


37. 


7923 


8601 


38. 


8607 


8819 


39. 


5752 


7186 


40. 


2614 


5324 


41. 


3414 


4932 


42. 


4824 


7137 


43. 


5262 


6830 


44. 


3723 


5419 



Item 


T 


A 


45. 


5907 


6856 


46. 


3181 


3565 


47. 


5228 


7045 


48. 


3396 


4944 


49. 


4050 


5182 


50. 


4807 


7279 


51. 


3500 


5916 


52. 


3697 


4875 


53. 


3947 


6279 


54. 


3216 


3888 


55. 


5133 


6738 


56. 


3431 


6951 


57. 


3448 


5828 


58. 


4944 


6065 


59. 


4987 


6164 


60. 


3706 


5047 


61. 


3371 


6610 


62. 


4935 


6273 


63. 


2236 


2928 


64. 


3508 


6951 


65. 


2674 


3406 


66. 


3199 


6179 


67. 


4282 


6510 


68. 


4910 


6921 


69. 


4695 


5896 


70. 


5185 


6619 


71. 


3276 


6287 


72. 


3646 


4807 


73. 


4463 


5825 


74. 


2769 


5349 


75. 


2872 


5729 


76. 


2571 


3390 


77. 


3078 


5812 


78. 


4256 


6354 


79. 


3629 


4806 


80. 


3061 


4336 


81. 


2700 


5016 


82. 


2984 


6309 


83. 


3061 


4594 


84. 


2287 


3423 


84. 


2476 


4331 


86. 


3138 


5214 


87. 


3242 


5504 


88. 


3199 


4242 
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Table 9— Continued 



Item 


T 


A 


Item 


T 


A 


89. 


3095 


6963 


136. 


8504 


9015 


90. 


3061 


4154 


137. 


8289 


8623 


91. 


2494 


4833 


138. 


8332 


8691 


92. 


2941 


5758 


139. 


8383 


8464 


93. 


2545 


3709 


140. 


6973 


7406 


94. 


2296 


5351 


141. 


8065 


8093 


95. 


2941 


5158 


142. 


7979 


8247 


96. 


2279 


5430 


143. 


6199 


6443 


97. 


2528 


5316 


144. 


6526 


6875 


98. 


3164 


6802 


145. 


5589 


6366 


99. 


3431 


4831 


146. 


7670 


8131 


100. 


3293 


5742 


147. 


4058 


4958 


101. 


2502 


3270 


148. 


7481 


8004 


102. 


2330 


4909 


149. 


7205 


7509 


103. 


2167 


4345 


150. 


4858 


5325 


104. 


1763 


3015 


151. 


3689 


4269 


105. 


2623 


5214 


15?. 


6139 


6704 


106. 


2674 


6761 


153. 


8452 


8738 


107. 


2253 


2835 


154. 


5082 


5727 


108. 


2769 


5833 


155. 


4918 


6015 


109. 


2717 


5122 


156 • 


4463 


4731 


110. 


2064 


4040 


157 . 


2769 


3052 


111. 


2244 


4953 


158. 


7412 


7981 


112. 


2691 


5589 


159. 


3723 


4606 


113. 


1737 


2898 


160. 


3895 


5641 


114. 


1290 


1606 


161. 


4101 


5085 


115. 


3095 


5696 


162. 


5245 


5680 


116. 


9630 


9655 


163. 


6019 


7551 


117. 


9372 


9380 


164. 


1221 


2113 


118. 


9372 


9495 


165. 


5073 


5438 


119. 


9441 


9615 


166. 


5125 


5815 


120. 


9596 


9612 


167. 


4961 


5403 


121. 


9837 


9837 


168. 


3972 


4400 


122. 


9845 


9854 


169. 


3345 


6234 


123. 


9699 


9716 


170. 


4050 


4645 


124. 


9854 


9854 


171. 


7506 


7837 


125. 


8633 


8738 


172. 


3216 


4437 


126. 


9097 


9297 


173. 


1238 


1427 


127. 


9914 


9914 


174. 


3121 


4624 


128. 


9243 


9259 


175. 


6191 


6344 


129. 


6225 


7161 


176. 


2115 


2891 


130. 


7334 


7450 


177. 


2554 


3136 


131. 


4067 


5215 


178. 


4420 


5908 


132. 


9235 


9283 


179. 


2958 


4687 


133. 


7334 


7360 


180. 


3543 


3883 


134. 


8555 


8615 


181. 


3783 


5978 


135. 


6604 


6851 


182. 


1539 


2613 
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Table 9- -Continued 



Item 


T 


A 


183. 


2046 


3161 


184. 


1952 


3188 


185. 


2107 


2395 


186. 


2279 


4402 


187. 


1780 


2724 


188. 


2038 


2482 


189. 


1685 


2207 


190. 


3285 


3498 



N * 1163 



* T ** proportion of total group getting item right, A * proportion of 
those attempting item answering correctly; decimal point properly pre- 
ceding each proportion has been eliminated* 



Table 10 



Distribution of carelessness scores (C) on CMT 



Carelessness Score Frequency, 

0 112 

1 190 

2 151 

3 142 

4 122 

5 104 

6 76 

7 53 

8 36 

9 32 

10 25 

11 30 

12 22 

13 22 

14 10 

15 10 

16 2 

17 5 

18 3 

19 4 

20 1 

21 2 

22 0 

23 3 

24 3 

25 2 

26 0 

27 0 

28 1 



N - 1163 
M * 4.54 
SD « 4.26 



26 




Table 11 



Comparison of careless and careful CMT subjects on CMT measures 





R* 


W 


Careless subjects, 
O C _ 


N * 32 
R-W 


R-W 


R-W 

R-W 


M 


94.00 


93.75 


2.25 


17.00 


20.97 


167 .03 


.130 


SD 


7.01 


6.76 


5.41 


3.68 


11.24 


5.69 


.057 


M 


54.28 


44.72 


Careful 

91.00 


subjects, 

2.06 


N * 32 
21.31 


87.25 


,310 


SD 


17.58 


25.49 


41.16 


1.73 


11.38 


37.13 


.209 


diff 

In 


39.72 


49.03 


88.75 


14.94 


.34 


79.78 


.180 


M*s 

t 


11.68 


10.35 


11.90 


20.43 


.12 


11.83 


4.65 



sig. level for 60 &* f 

.10 - 1.67 
.05 * 2.00 
.01 * 2.66 
.001 ■ 3.46 



* R-~right, W— ■ wrong, 0--omitted, C--carelessnes8 score 



Some of the subjects in these two samples had also taken the D-48, 20 
careless and 23 careful subjects. The D-48 measures for the subsamples 
of CMT-selected students is given in Table 12. Again, as we found in 
the previous analysis, the C means do not differ (t « 1.28) although the 
difference is in the appropriate direction. Significances close to or 
beyond the .001 level occurred for the following measures: R, t • 3.08; 

W, 4.17; R-W, 3.89; R-W/R-W, 4.12. The R*W at 2.63 is close to the .01 
level and Omitted almost makes the .05 level. 

Another analysis was made of the relationship of carelessness on CMI 
8 cores by comparing the 50 subjects scoring highest on C (C 13 or more) 
with a random selection of 50 from the 112 subjects who had sero C 
scores. No attempt was made to match them on total score--R-W on this 
test. The means and standard deviations for the test measures are given 
in Table 13. All of the t*s are significant far beyond the .001 level 
except for R, which is non-significant. Thus, although the two samples 
get about the same number of items correct, the careless subjects tended 
to omit fewer items but to get more items wrong. They averaged only a 
little better than 8 per cent right of the items attempted. The careful 
subjects, on the other hand, got almost two-thirds of the items attempted 
correct. By omitting more items and by getting fewer items wrong, the 
careful subjects end up with a total score that averages 62 raw score 
points higher than the careless subjects. 

The intratest correlations for the seven test measures are given in 
Table 14 for the D-48 and in Table 15 for the CMT; in addition Table 16 
gives the correlations for Part 1 of the CMT and Table 17 for Part 2. 

For the D-48 the test score, R, shows a significant negative correlation, 
-.77, with the number of incorrect answers, W. The number of omitted 
items, 0, and the number of careless errors, C, both show negative 
correlations of about the same magnitude, -.31 and -.34 respectively, 
with R. It is of interest to note that R-W correlates .94 with R; thus, 
had a "correction" formula been used and wrongs subtracted from rights, 
the relative standing of subjects would not have been greatly altered. 

Carelessness is significantly but not highly related to wrongs, r * .36, 
but is unrelated to the number omitted or it«* obverse, the number 
attempted. No doubt the restriction of range for C has attenuated the 
relationship with these measures. 

In sum, then, subjects who scored highest on the D-48 tended to answer 
more items and to omit fewer; they made fewer errors of all kinds, includ- 
ing careless errors. 

On the CMT, however, a somewhat different pattern of relationship among 
the test measures may be seen in Table 15. Rights and wrongs show a 
very low positive correlation, .09 (with N • 1163 an r of .075 is needed 
for significance at the .01 level) indicating that there is only a 
slight tendency for subjects who got more items right also to get more 
items wrong. The number omitted is highly negatively correlated with R, 
-.73; this may be contrasted with the value of only -.31 obtained on the 
D-48 for these measures. Careless errors are not related since a non- 
significant r of .04 was obtained between R and C. 
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Table 12 



Comparison of careless and careful CMC subjects on D-48 measures 



Careless subjects, N * 20 

R-W 





R* 


W 


0 


C 


R-W 


R-W 


R-W 


M 


20.90 


19.80 


3.30 


.65 


1.10 


40.70 


.040 


SD 


6.94 


8.32 


4.29 


.73 


14.71 


4.29 


.360 








Careful 


subjects, 


N - 23 






M 


26.75 


11.09 


6.17 


.39 


15.65 


37.83 


.420 


SD 


5.19 


4.82 


4.83 


.57 


8.85 


2.59 


.222 


diff 

in 


’ 5.85 


8.71 


2.87 


.26 


14.55 


2.87 


.380 


M*s 
















t 


3.08 


4.17 


2.00 


1.28 


3.89 


2.63 


4.12 



sig. level for 40 d.f. 

.05 - 2.02 
.01 * 2.70 
.001 - 3.55 



* R~ right, W—wrorr:, 



0--omitted, C-- carelessness score. 



Table 13 



Comparison of most careless and most careful subjects on CMT measures 



R* 



W 



Careless subjects, N ** 50 
0 C RW 



JSSL 



R-W 

R+W 



M 


89.34 


98.08 


2.58 


17.40 


12.82 


165.86 


.076 


SD 


10.00 


8.62 


6.74 


3.88 


15.54 


7.33 


.095 








Careful 


subjects, 


N - 50 






M 


96.62 


23.68 


73.70 


0.00 


74.84 


110.40 


.667 


SD 


26.13 


8.99 


26.94 


0.00 


26.40 


27.66 


.137 


diff 

in 


• 

3.28 


74.40 


71.12 


17.40 


62.02 


55.46 


.591 


M's 
















t 


.82 


41.82 


17.93 


31.41 


14.17 


13.57 


24.11 



sig. level for 100 d.f. 

.05 * 1.98 
.01 * 2.63 



* R-- right, W — wrong, 0 — omitted, C — carelessness score, 



Table 14 



Intratest correlations of D-48 
N - 770 





W 


0 


C 


R-W 


R-W 


R 


-77 


-31 


-34 


94 


31 


W 




-36 


36 


-94 


36 


0 






1 

o 

w 


( 03) 


-100 


c 








-37 


( 04) 


R-W 










(•03) 


R-W 



















Table 15 










Intratest correlations of CMT 










N - 1163 








W 


0 


C 


R-W 


R-W 


R 


09 


-73 


( 04) 


73 


80 


W 




-75 


80 


-62 


66 


0 






-57 


(-06) 


-99 


C 








-51 


49 


R-W 










17 


R-W 













a Non-significant r enclosed in parentheses. 



R-W 

R*W 

85 

-98 

22 

-37 

98 

-22 



R-W 

R-W 

25 

-92 

46 

-71 

83 

-36 
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The CMT score, R-W since it is "corrected," correlates .73 with R, a 
value touch lower than that obtained on the D-48. On the other hand, a 
much higher value, .80, is obtained with the total number attempted. 

Before suumarizing these relationships it is instructive to look at 
Tables 16 and 17 where the correlations have been given separately for 
the two parts of the CMT. Rights and wrongs are correlated significantly 
positively, .40, for Vocabulary, but significantly negatively, -.51, for 
Analogies. Thus, there was in general a tendency for subjects who got 
more items right also to get more Vocabulary items wrong but to get few g r 
Analogies items wrong. Likewise the number omitted is much more strongly 
related to R for Vocabulary, - .85, than for Analogies, -.41. Careless 
errors show an opposite trend with R and C positively correlated, .26, 
for Vocabulary but having a negative value, -.28, for Analogies. Further, 
the test score shows meaningful differences between the two parts; R and 
R-W is correlated .60 for Vocabulary and .94 for Analogies. This latter 
value is the same as that obtained for the comparable measures on the 
D-48. 

The pattern of correlations for the measures on the total CMT obscures 
what seems to be somewhat different relations on the two parts. This 
finding is amplified in Tables 18, 19, and 20 where the intertest correla- 
tions are given between the D-48 and the CMT total and the parts. The 
correlation for R on the D-48 and Vocabulary is a non- significant .07 but 
rises to .42 for Analogies. D-48 R scores are more highly correlated 
with Analogies wrongs, -.43, than with Vocabulary W, -.29. The number 
attempted on the CMT is negatively correlated with the number right on 
the D-48, -.13, for Vocabulary but positively, .19, for Analogies. A 
reversed pattern for D-48 wrongs is found, .22 and -.13 respectively. 

Finally, total score on the D-48, R, correlates .33 with Vocabulary R-W 
on the CMT but .49 with Analogies. It seems clear that Part 2 of the 
CMT is more closely related to the D-48 than Part 1. 

Further evidence for this claim may be seen in the intratest correlations 
for all of the measures on the CMT presented in Table 21 for Vocabulary 
and Analogies, Table 22 for Vocabulary and Total, and in Table 23 for 
Analogies and Total. The diagonal entries representing the same measures 
have been underlined for ease in reading the tables. Rights are less 
strongly related than wrongs, .56 and .73, for Vocabulary and Analogies 
as shown in Table 21. Careless errors correlate .52 and the test score 
itself, R-W, shows a value of .72. Further comment about this latter 
relationship will be made below. 

Comparison of Tables 22 and 23 shows that Vocabulary measures are more 
highly correlated with Total than Analogies. For example, tfc* values for 
rights are .95 and .80; for wrongs, .96 and .90; for omitted, .98 and 
.85; for carelessness, .89 and .72; and for the test score itself, R-W, 
.95 and .90. No doubt these values are related to the greater number of 
items in Vocabulary, 115, as compared to 75 items in Analogies, but the 
discrepancy for C, .89 as contrasted with .72, indicates that Vocabulary 
carelessness contributed proportionally much more to total C than did 
Analogies C. 
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Table 16 





Intratest correlations of CMT, 


part 1 


(Vocabulary) 








N - 1163 






R-W 




W 0 


C 


R-W 


R+W 


R+W 


R 


40 -85 


26 


60 


85 


08 


W 


-82 


80 


-49 


82 


-83 


0 




-62 


-10 


-100 


43 


C 






-45 


62 


-66 


R-W 








10 


80 


R+W 




Table 17 






-43 




Intratest correlations of CMT 


, part 2 (Analogies) 








N - 1163 






R-W 




W 0 


C 


R-W 


R+W 


R+W 


R 


-51 -41 


-28 


94 


83 


72 


W 


-58 


54 


-77 


07 


-95 


0 




-31 


(-06) a 


-84 


33 


C 






-43 

f 


( 03) 


-53 


R-W 








57 


91 


R+W 










21 



a Non-significant r enclosed in, parentheses . 
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Table 18 



In ter test correlations of D-48 and total CMT measures 

N - 770 



D-48 


R 


w 


0 


R 


21 


-37 


12 


W 


-16 


47 


-21 


0 


1 

o 

O' 


-16 


15 


c 


(-08) 


17 


(-06) 


R-W 


20 


-44 

-rt 


17 


R+W 


( 06) 


16 


-15 


R-W 

R+W 


19 


-46 


19 



C 


R-W 


R-W 


R-W 

R+W 


-44 


44 


-12 


44 


52 


-48 


21 


-50 


-13 


( 07) 


-15 


10 


-Ik 


-19 


( 06) 


-18 


-51 




-17 


50 


13 


(-07) 


15 


1 

O 


-51 


50 


-18 


51 



a Non- significant r enclosed in parentheses. 
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Table 19 



Interte8t correlations of D-48 and CMT measures: part 1 (Vocabulary) 



N - 770 
CMT 



D-48 


R 


W 


0 


C 


R-W 


R+W 


R-W 

R+W 


R 


C22) a 


-29 


13 


-36 


33 


-13 


34 


W 


(-01) 


40 


-22 


47 


-37 


22 


-42 


0 


(-07) 


-17 


14 


-17 


( 08) 


-14 


13 


C 


(-03) 


15 


(-07) 


17 


-16 


( 07) 


-15 


R-W 


( 04) 


-37 


18 


m A A 

“F T 


37 


-18 


40 


R+W 


( 0?) 


17 


-14 


17 


(-08) 


14 


-13 


R-W 

R+W 


( 04) 


-37 


20 


-45 


38 


-20 


42 








Table 20 








Intertest correlations 


of D-48 


and CMT 


measures : 


part 2 (Analogies) 


D-48 


R 


w 


0 


CMT 

C 


R-W 


R+W 


RW 

R+W 


R 


,, 42 


-43 


( 06) 


-38 


49 


19 


49 


W 


-40 


49 


-15 


42 


-50 


-13 


-53 


0 


(-02) 


-11 


13 


(-08) 


( 03) 


(-09) 


( 07) 


c 


-16 


18 


(-04) 


11 


-19 


(-06) 


-19 


R-W 


43 


-49 


11 


-42 


52 


17 


54 


R+W 


( 02) 


11 


-13 


( 08) 


(-03) 


C09) 


(-06) 


R-W 

R+W 


43 


-49 


13 


-42 


52 


16 


54 



a Non- significant r enclosed in parentheses. 
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Table 21 



Intratest correlations of CMT part 1 (Vocabulary) and part 2 (Analogies) 









N 


- 1163 
Part 1 






R-W 


Part 2 


R 


W 


0 


C 


R-W 


R-W 


R-W 


R 


56 


08 


-61 


( 06) a 


37 


70 


10 


W 


-17 


73 


-61 


41 


-42 


28 


-62 


0 


-25 


-47 


73 


-27 


( 01) 


-60 


30 


C 


-34 


73 


-45 


52 


-55 


09 


-69 


R-W 


63 


-56 


(-05) 


-30 


72 


42 


63 


R-W 


25 


47 


-73 


27 


(-01) 


60 


-30 


R-W 

R-W 


45 


-72 


34 


-39 


62 


( 05) 


71 



a Non- significant r enclosed in parentheses. 
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Table 22 



Intratest correlations of CMT total test and part 1 (Vocabulary) 









N * 


1163 














Total CK£ 






R-W 


Part 1 


R 


W 


0 


C 


R-W 


R+W 


R+W 


R 


95 


29 


-83 


25 


55 


88 


( 04) 3 


W 


22 


96 


-81 


72 


-50 


75 


-84 


0 


-72 


-73 


98 


-57 


(-06) 


-98 


46 


C 


( 06) 


83 


-61 


89 


-53 


54 


-74 


R-W 


71 


-55 


-09 


-39 


95 


18 


77 


R+W 


72 


73 


-98 


57 


( 06) 


98 


-46 


R-W 


23 


-84 


43 


-59 


78 


-35 


95 


R+W 






















Table 23 








Intratest 


correlations 


of CMT 


total test 


and part 


2 (Analogies) 








Total CMT 






R-W 


Part 2 


R 


W 


0 


C 


R-W 


R+W 


R+W 


R 


80 


-33 


-31 


-37 


84 


41 


57 


W 


-14 


90 


-53 


77 


-70 


41 


-87 


0 


-61 


-64 


85 


-47 


(-06) 


-82 


39 


C 


(-07) 


50 


-30 


72 


-38 


23 


-47 


R-W 


64 


-61 


(-01) 


-59 


90 


13 


77 


R+W 


83 


21 


-70 


( 07) 


52 


74 


09 


R-W 


35 


-81 


32 


-73 


80 


-19 


88 



R+W 



a Non- significant r enclosed in parentheses. 
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To advance the argument further, Table 24, a rearrangement of Table 19, 
has been made so that the comparable test measures for Vocabulary and 
Analogies are in parallel rows* Thus, Vocabulary rights correlate .68 
with Analogies scores, R-W, but Analogies rights show only .37 with Vo- 
cabulary R-W. Vocabulary wrongs are more negatively correlated with 
Analogies scores, -*56, than Analogies wrongs are correlated with Vo- 
cabulary scores, -.42. On the other hand, Vocabulary carelessness is 
less highly related, -*30, to Analogies scores than Analogies careless- 
ness is to Vocabulary scores, -.55. The patterns of the intratest 
correlations seem to indicate that the test score and the test measures 
are different for the two parts of the CMT. This is advanced as further 
support for the point made above that important relationships may be 
overlooked if the total score and measures are accepted without examining 
the same relationships for the two parts* 

The CMT Manual (Terman, 1956) reports correlations between scores on the 
two parts of the test as *75 for 331 undergraduate and graduate students 
and as .76 for the 1004 subjects of the Stanford Gifted Study. It is 
pointed out (p* 8) that "no use has been made of either subtest alone. 

. . .The coefficients show that the two parts have much in common, in 
terms of measurement, and that the use of a total score is justified. 
However, there is still enough difference between the parts to indicate ^ 
that they are different approaches to the measurement of mental ability. 

Analysis of the two scores on the Governor* s School subjects clearly 
supports the differences between the parts noted in the Manual and the 
present writer strongly urges that part scores as well as total scores 
be reported and that further study of the correlates of the part scores 
be made with different types of subjects. 

Personal i tv Measures . The results of the correlational analysis for the 
intelligence test measures and the personality measures are presented in 
Table 25 for the D-48 and in Table 26 for the CMT. To simplify the pre- 
sentation of these data and to avoid cluttering the tables non- signifi- 
cant correlations have been enclosed in parentheses; non-significance in 
this case means that the correlation coefficient did not differ signifi- 
cantly from zero at the .05 level for a one-tailed test or at the .10 
level for a two-tailed test. 

Since some of the correlations were in a direction contrary to expecta- 
tion, the two-tailed test was used to indicate their departure from zero. 
The actual level of significance for the other correlations will be given 
below in appropriate sections. 

1. Anxiety: On the D-48 test scores were negatively correlated with 

the MMPI A scale as predicted. For males the correlation of R, the num- 
ber correct, and A was “.17, significant beyond the .001 level; for fe- 
males the value was lower, -.09, and lies close to the .025 level. 

The A scale was unrelated to the number wrong, W, for males (r * .07) 
and the value for females, .08, is barely significant at the .10 level 
for a one-tailed test. It was predicted that anxious subjects would be 
less inclined to guess so that they should have fewer wrong answers but 
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Table 24 



Intratest correlations of measures on CMI Vocabulary and Analogies 

N * 1163 
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these data do not support this hypothesis. The extension of the predic- 
tion to the number of omitted items, however, was confirmed partially; 
for males A and 0 were correlated in the expected direction, r * .14 
(close to .005 level), but for females the value of .03 was non-signifi- 
cant. Although no predictions were made about the relationship of care- 
less errors and anxiety, it was found that for females the obtained 
correlation, .09, lies close to the .05 level. 

It is of interest to note that had a "correction" been used, the rela- 
tionship of anxiety and intelligence test performance would not be 
greatly altered; that is, the correlations of A and R-W are quite similar 
(identical for females) to the A and R correlations. The same observa- 
tion is true when the test scores are expressed as ratios in the last 
column • 

Anxiety seems to be less strongly associated with performance on the 
CMT. For females the correlation of A ana R-W is non-significant (r * 
-.05) and for males the value of -.13, although significant at the .005 
level, is lower than its D-48 counterpart. 

Other significant correlations with A for males are: R, -.12 (.005 

level); C, .09 (.025 level); R-W/R-W, -.10 (.01 level). For females two 
correlations, both .06 (close to the .05 level), appear for W and C. 

The other anxiety measure employed was the Adjective Check List Counsel- 
ing Readiness scale, Crs. It should be noted that this scale has two 
versions, one for males and one for females, so that the resulting 
correlations for the two sexes cannot be compared directly. 

On the D-48 none of the correlations for females was significant but 
all except the test score, R (r ■ .05) were for males. These correla- 
tions and their levels of significance are: W, -.18 (.0005 level); 

0, .21 (.0005 level); C, -.08 (close to .05 level); R-W, .13 (.01 
level); R+W, -.21 (.0005 level); and R-W/R+W, .15 (.01 level). Thus 
males who are anxious in the sense of the Crs scale tended to have 
fewer wrong answers, to omit more (or attempt fewer) items, but to 
have proportionately more correct answers. 

The results with the CMT scores show even more clearly that the results 
are contrary to the hypothesis that anxiety is negatively related to 
intelligence test performance. Both males and females show significant 
positive correlations of R-W with Crs; the respective values of .17 and 
.37 both surpass the .001 level. The other significant correlations 
for males are: R, .07 (.10 level); W, -.17 (.001 level); 0, .07 (*10 

level); C, -.12 (.01 level); and R-W/R+W, .18 (.001 level). For females 
significant correlations are: R, .32 (.0005 level); W, -.17 (.001 level); 

0, -.10 (.02 level); C, -.17 (.001 level); R+W, .14 (.001 level); and 
R-W/R+W, ,28 (.0005 level). Both sexes, then, showed a similar pattern 
on the CMT and Crs to that indicated for males on the D-48. 

The ACL Manual (p. 9) describes «.ne Counseling Readiness scale as being 
related to the "clinical concept of ’available anxiety'" and states that 
"the high-scorer on Crs is predominantly worried about himself and 
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ambivalent about his status* He feels left out of things, unable to 
enjoy life to the full, and unduly anxious.” The results cited above 
seem to indicate that for the present subjects the kind of anxiety tapped 
by Crs is positively rather than negatively related to intelligence. 

The ACL Self-Confidence scale may be considered in some ways as the 
obverse of anxiety since the Manual (p. 6) states that •indicative adjec 
tives on S-C£d include ’’clear- thinking" and ’’patient.’’ On the D-48 none 
of the measures were significantly correlated except for the number 
omitted and its opposite, the number attempted. For males an r between 
S-Cfd and 0 of - .14 was obtained with a comparable value of - .13 for 
females; these are significant at the .005 level for both sexes. The 
values for R+W are, of course, the same except for the reversal of sign. 

On the CMT 0 and S-Cfd give r*s of -.08 for males (.05 level) and -.09 
for females (.025 level); the values for R+W with reversed sign are in 
this instance exactly the same. Males show one additional significant 
correlation, .09 with R (.025 level) and females show two, .03 with R 
(.025 level) and .06 with W (.05 level). The self-confident subject, 
then, is somewhat inclined to attempt more items although his overall 
intellectual performance Is no higher than those less self-confident. 

It has been noted above that the MMPI anxiety scale, A, showed a negative 
correlation with total scores on the D-48 and the CMT although the r of 
-.05 for the girls on the CMT failed to reach a nominal level of signi- 
ficance. Since there is some evidence that anxiety measures may have a 
non-linear relationship to intellectual test scores, the scatterplots 
for the two tests were examined for this possibility. No evidence of 
curvel inear ity was apparent. 

A further analysis was made by grouping the subjects according to A 
scale level in five-point intervals; the sexes were treated separately. 
The mean scores of these eight anxiety levels for the D-48 and the CMT 
are shown in Table 27. Some tendency may be seen for the lower levels 
of A to have higher means on the intellectual measures as would be 
expected from the correlational study. The differences between the 
means, however, proved not to be significant when examined by analysis 
• f variance. The F's obtained are shown in the table. 



Thus, although there is some negative relatioship between anxiety and 
intellectual performance as measured by these tests, it does not seem to 
be an important source of variance in accounting for individual differ 
ences in intelligence test scores. 



2. Impulsiveness: The two MMPI scales used to measure impulsiveness, 
Pd and Ma, both showed similar patterns of correlations for both sexes 
on the two intelligence tebts as is clear from Tables 25 and 26. 



On the D-48 significant correlations with Pd for males are: R,-. 19 

(.0005 level of significance); 0, .16 (.005 level); R+W, -.16; R-W, 

(.005 level); and R-W/R+W, -.11 (.025 level). For females the signifi- 
cant correlations are: R. -.19 (.0005 level); W, .16 (.005 level); C, 

.13 (.005 level); R-W, -.19 (.0005 level); and R-W/R+W, -.18 (.0005 level). 



43 



Table 27 



Score 01 
A scale 

0-4 

5-9 

10-14 

15-19 

20-24 

25-29 

30-34 

35-39 

Totals 



Score on 
A scale 

0-4 

5-9 

10-14 

15-19 

20-24 

25-29 

30-34 

35-39 

Totals 



Relation of scores on intelligence tests 
i-o levels of MMPI Anxiety scale, A 



Males females 



Mean CM! 



N 


R-W score 


71 


70.97 


115 


61.23 


114 


59.95 


90 


60.16 


79 


57.99 


29 


59.72 


27 


57.19 


6 


40.67 


531 


61.07 



Mean CMT 



N 


R-W score 


63 


58.63 


121 


55.20 


129 


51.19 


132 


52.95 


86 


54.37 


50 


58 >54 


35 


47.77 


10 


43.80 


626 


53.80 



Mean D-48 
N R score 



Mean D-48 
N R score 



42 


31.10 


78 


30.18 


74 


31.19 


64 


29.39 


53 


30.25 


16 


28.81 


20 


27.30 


4 


19.25 



39 


29.87 


91 


30.48 


90 


29.08 


83 


28.96 


60 


30.00 


26 


28.65 


23 


29.26 


7 


23.00 



351 


30.02 


419 




Values of F 






Males 


Females 


D-48 


1.00 


1.00 


CK2 


1.86 


1.11 



29.45 
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The Ma correlations with the D-48 measures for males are all significant 

beyond the .0005 level: R, -.22; W, .22; R-W, - - 23 J ; ^ '*** • “; 22 \ 0 

For females they are: R, -.13 (.005 level); W, .18 (.0005 level); C, . 

(.01 level); R-W, -.17 (.0005 level); and R-W/R+W, -.18 (.0005 level). 



The subject high on Pd and on Ma, then, tends on the D-48 to get more 
items wrong and fewer items right and thus to obtain lower test scores. 
In addition high Pd-Ma females tend to make more careless errors. 

On the CME males show a Pd correlation of -.11 with R (.01 level), .08 
with C (.05 level), -.13 with R-W (.005 level), and -.09 with R-W/R-W 
(.025 level). For females the values are: R, -.08 (.025 level); W, .19 

(.0005 level); 0, -.08 (.025 level); C, .21 (.0005 level); R-W, -.18 
(.0005 level); and R-W/R+W, -.22 (.0005 level). 

For Ma the significant r*s for males are: R, -.11 (.01 level); W, .17 

(.0005 level); C, .18 (.0005 level); R-W, -.20 (.0005 level); R-W/R-W, 
-.21 (.0005 level). Comparable values were obtained with females: R, 
-.06 (.05 level); W, .21 (.0005 level); 0, -.10 (.01 level); C, .22 
(.0005 level); R-W, -.19 (.0005 level); R-W, .07 (.05 level); and 
R-W/R-W, -.24 (.0005 level). 



Pd and Ma are associated on the CMT with tendencies to get more items 
wrong and fewer items right with resulting lower test scores and also 
to make more careless errors • In females there is a tendency to omit 

fewer items. 

The two ACL scales, Lability and Need Change, included as measures of 
impulsiveness showed very few significant correlations with the intelli- 
gence test measure 8 and these tended to be contrary to expectation. 

For the D-48 only males showed significant correlations and all of these 
were on Lability: R, .16 (.01 level); W, -.13 (.02 level); R-W, .15 

(.01 level); and R-W/R-W, .14 (.01 level). 

Both sexes had some significant correlations on the CMT and Lability but 
only females showed any on Need Change. The values for males on Lability 
are: W, -.13 (.01 level); C, -.14 (.01 level); R-W, .14 (.01 level); and 

R W/R-W, .15 (.001 level). For females they are: R, .14 (.001 level); 

C, -.08 (.05 level); R-W, .15 (.001 level); R-W, .07 (.10 level); and 

R-W/R-W, .10 (.02 level). Low correlations on a few measures for females 

on Need Change appeared as follows: R, .07 (.10 level); 0, -.06; and 

R+W, .06 (close to .10 level). 

It muse be concluded that the Lability and Need Change scales on the ACL 
for the present subjects are probably unrelated to the intellectual meas- 
ures . 

3, Caution: On the D-48 none of the measures are significantly corre- 

lated with Self-Control for either sex. On Need Order significant cor- 
relations for males are: 0, -.15; and R-W, .15 (.01 level); C, .12 

(.01 level) . For females only 0, -.13; and R+W, .13 (.01 level) reached 

nominal significance. Need Abasement showed a few significant correla- 
tions for each sex. For males they are: R, -.10 (.10 level); 0, .11; 
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and R+W, -.11 (.05 level). For females they are: 0, .08; and R+W, -.08 

(.10 level); C, .09 (.075 level). 

The CMT measures also showed very few significant t - # 08 

ACL measures of caution. On Self-Control for mal© 8 _ q Q ,* 05 

( 10 level); but in the expected direction, 0, .09; and R-W, • (• 

level)^ Ull a. C, -.07 (.10 level) . A similar pattern is found for 

females: R, -.07; 0, .07; R+W, -.07 (.10 level). 

on Nppd Order there are no significant correlations for females and ® n ly 
On Need Order there are no sig level). Need Abasement shows 

two for males: R, -.08; R-W/R+w, .ue yuj jevej/ 

the following r's for males: R, '• U (,02 n q eV ®^’ S’o^f’os levtlj; R+W, 
(.01 level). For females they are: R, -.09, R W, .09 (.05 )> 

-.06 (.10 level). 

It is apparent that caution as inferred from the ACL to 

Control! Need Order, and Need Abasement is not systematically related to 

the two intelligence tests. 

4. Verbal Interests: There were few significant i0 “ ' °^ng 

D-48 measures and the verbal interest scale of the Strong . Advertis^ g 
Man showed the following for males: R, -.12 (.05 level), • • * f 

R+W, -.11 (.10 level); R-W, -.09 (.10 level). None * e ““Hnd R«, 
males on Lawyer were significant and on Author Journa y f 

.15 and - .15 (.01 level) appear. A similar pattern may be seen i Eor^ 

females. Advertising Man has: R, -.13 (.01 level), 0, • » o’and 

-!o8 for R+W (.10 level) emerge. Author-Journalist has significant cor 

relations on R, -.11 (.05 level); and on 0, .14; and R+W, -.14 (.01 
level) . 

As expected, scores on the D-48 are basically unrelated to verbal 
interests although there may be a slight tendency for a negative rela 
tionship, particularly in females. 

On the COT the expected positive relationship was 

of the scales. Advertising Man showed no ® i 8^ f ?- cant: co " |; 07 . . 

males and only three for females: R, .08 (.025 level); 0, 07, and 

R+W, .07 (.05 level). Lawyer was significantly corre: La ed ^ 

the CMT measures for males: R, .23 v * 000 ^. ( m , v pveiv 

0, -.07 (..05 level); R-W, .27 (.0005 level); R-W, .10 (* 0 \l eve J>» 
R-W/R+W, .18 (.005 level). For females the r s are: R, .16 (. 

level); 0, -.10 (.01 level); R-W, .13 (.0005 ^’^f^ ^for males are- 

level). Author- Journalist and COT measure correiatlons for males ar^ 

R 18 ( 0005 level); W, -.10 (.01 level); R-W, .22 (.0005 level), R+w, 
.08’ (.05 level); R-W/R+W, .13 (.005 level) . For f emales the va ues are : 
R, .15 (.0005 level); 0, -.07 (.05 level); R-W, .15 (.0005 level), ,+W, 
.08 (.025 level); R-W/R+W, .10 (.01 level). 

Thus two of the verbal interest scales on the stro ” 8 ’ L ^ e li n J n A “he° r ' 
Journalist, show marked relationship to performanceontheCOTin the^ 
expected direction. This tendency is somewhat stronger for 
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The findings with the D-48 and the CMI support the previous report 
(Welsh, 1967) that subjects with higher verbal interests tend to do 
better on a verbal test of intelligence* 



It has been noted above (p . 32 ) that the two parts of the CM! show dif- 
ferent correlational patterns and that CMI Analogies seems more like the 
D-48 in this respect than Vocabulary. The correlations of R-W scores on 
Vocabulary and Analogies for the three verbal-linguistic scales are: 



Vocabulary Analogies 





m 


f 


m 


f 


Advertising Man 


•10 


.09 


- .04 


- .02 


Lawyer 


.28 


.16 


.21 


.07 


Author- Journalis t 


.22 


.19 


.17 


.08 



It is apparent that these part-score correlations are consistent with 
the suggestion that the correlates of the two CMI parts may reveal rela- 
tions obscured by the total score* In these data all three Strong scales 
are more highly positively correlated with Vocabulary than with Analogies 
this is truti for males and for females. 
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Conclusions and Recommendations 



Both of the intelligence tests proved to be suitable for the gifted and 
talented adolescent subjects studied in this research. These students 
had no difficulty in following the instructions and responding to the 
test items. It was observed informally that they seemed to enjoy the 
D-48 more than the CMT and many of them made spontaneous comments to the 
present writer at the conclusion of the testing session to ^ this effect. 
Some of the comments were: "that was neat, lots of fun, "will we 
have more tests like that one?' and "that's the best yet. A few said 

that they had tried harder on the D-48 to "get them all right than ey 

had on the CMT . 



Some of the subjects raised questions about guessing on the CMT and it 
may well be that for many this was a reflection of the rights -minus - 
wrongs scoring penalty frequently employed in educational settings. For 
others, however, it may have been a fear that they would find the words 
in the Vocabulary part too difficult. There is no doubt that forewarn- 
ing of test difficulty was passed around from one group of subjects to 
the next. All of the testing at the Governor's School was done with 
separate groups on different days over a four-week period of time *<-cor 
ing to a prearranged schedule and, although they were as*ed not to dis- 
cuss any particular test with their fellows until all groups had com- 
pleted that test, it is unlikely that the admonition was adhered to 

strictly. 



The distribution of scores on the CMT, however, as well as those on the 
D-48 resulted in a wide range of scores even with this highly selected 
and motivated population; and, furthermore, the correlations between 
these two tests as well as with the personality and interest measures 
were for the most part consistent with expectations derived generally 
from previous studies. 



While attending the Governor's School the students were not given any 
grades or marks on their work so that there is no way to demonstrate 
directly the relationship between these intelligence test scores and 
academic achievement. The CMT Manual cites evidence of positive corre 
lation with college grades and Gough and Domino (1963) report correla- 
tions of D-48 scores with grades for fifth and sixth grade pupils as 

.49 and .32. 



In most of the classes at the school, however, the teachers ranked their 
students on a number of dimensions including intellectual competence and 
amount of progress. It would be possible to convert these ranks to 
scores and correlate them with the CMT and the D-48 . 



Both of the tests may be vulnerable to the effects of anxiety 8 * nc ® 
scores on both were negatively correlated with the A scale of the MMPI. 
It must be noted, though, that the overall trend is relatively slight. 

T e highest correlation obtained, -.17, on the D-48 and A for males, 
would still account for less than 3 per cent of the variance. In the 
pxesent study no marked decrement in intellectual scores seems to appear 
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except at the highest anxiety score level; this relationship should be 
explored further. 

The effect of impulsiveness as measured by the Pd and Ha scales of the 
MMPI seems to be somewhat stronger than that of anxiety. Significant 
negative correlations were obtained for both sexes on both scales for 
both intelligence tests but, even so, only about 5 per cent of the vari- 
ance would be explained by the highest correlation shown, -.22 on the 
D-48 and Ma for males. There is evidence (Dahls trom and Welsh, 1960) 
that many socially unfavorable personality characteristics are asso- 
ciated with MMPI profiles having peak scores on Pd and Ma. It would be 
instructive to identify a subgroup of the present subjects with the Pd 
Ha profile configuration (code type 49, Dahlstrom and Welsh, p. 192) and 
study intensively their other psychometric features. 

The significant positive correlation of the Adjective Check List Counsel- 
ing Readiness scale with CMT scores was unexpected. The magnitude of 
the correlation for females of .37 is almost at the level for the two 
intelligence tests themselves. The ACL Manual reports non- significant 
correlations of Crs with intellectual measures for 100 male subjects. 
Thus it is difficult to judge whether the correlations noted in the pre- 
sent study are more or less fortuitous or whether there is in fact a 
meaningful relationship. Additional studies may indicate the fruitful- 
ness of further investigation of this scale and its implication for in- 
tellectual performance. 



Verbal interest as measured by two of the Strong VIB scales, Lawyer and 
Author- Journalist, was not related to D-48 scales but showed the expected 
positive correlation with the CMT* From one point of view this finding 
implies that the subject lacking in verbal interest is not handicapped 
on the D-48 but that ha might do less well on the CMT* On the other hand, 
it might be argued that since school achievement is often ralated to ver" 
bal facility, the CMT may be a better predictor of academic success than 
the D-48. This lead should surely be followed up with other types of 
subjects and in other settings . 



An important unpredicted finding is that of a different pattern of inter- 
correlations for the uwo parts of the CMT with other measures used in 
this study and the apparent greater similarity of Analogies to the D-48 
in this regard. These results are compatible with the report of Horn 
and Bramble (1967) where they show a second order fa. tor of "fluid in- 
telligence," on which the D-48 has the highest loading of all the tests 
in their battery. Another of their major second order factors, crys- 
tallized intelligence," identified by the primary factor of verbal com- 
prehension is measured in their study by a test of general information; 
this dimension seems to be similar to CMT Vocabulary in terms of intel- 
lectual functions. The present writer urges that studies employing the 
CMT use part scores as well as the total; the part scores should be cor- 
related with personality and interest measures as well as with other in- 
tellectual measures. The pattern of scores for the present subjects 
might be examined to identify subgroups differing on whether the scores 
are relatively higher on Vocabulary or on Analogies. An intensive study 
of the other test measures a' ail able could then be carried out 
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Horn and Bramble were interested in rights-scores and wrongs -a cores in 
their study. In interpreting their results they comment: 

When a test is scored by the wrongs-score procedure, the person who 
adopts a strategy of avoiding errors has the advantage; when the 
same test is scored by the rights- score procedure, the person who 
adopts a strategy of getting as many right as possible, even at the 
cost of a few errors, has the advantage (p. 121). 

Since data from the present study include Rights, Wrongs, and other 
scores on the D-48 and the CMT, it would be possible to investigate some 
of the implications of Horn and Bramble's observation to discover dif- 
ferences in personality characteristics associated with these two strate- 
gies of test- taking. Moreover, such further study of the present sub- 
jects in this regard would also relate to the observation made earlier 
that some of the subjects may have found the CMT Vocabulary too diffi- 
cult. Such a subject may have employed a different strategy on the Anal- 
ogies and the D-48 than he did on Vocabulary. The finding in the pre- 
sent study concerning the relation of verbal interests to intelligence 
test scores may also be of importance here. 

No matter how ’'bright’' a young student is, he cannot do well on a vocabu- 
lary test unless he has the requisite knowledge of words and their mean- 
ing. However, on deductive tests like the D-48, that may be more basi- 
cally described as a function of "g" and that do not require specific 
kinds of knowledge or information in order to arrive at a correct answer, 
the student would not be at any disadvantage. There may be, then, a con- 
founding effect of knowledge and test-taking strategy in the CMT Vocabu- 
lary which might be elucidated by systematic analyses of the scores for 
the present subjects. 



A number o 2 recommendations, 3ome specific and some general, are made on 
the basis of the results from the present study and in the context of 
the particular analyses carried out in it. 

1. The D-48 should be added to the ust armamentarium of the school 
psychologist. It seems to have inherent appeal to subjects, is easily 
administered and scored, and is suitable for a wide range of age and of 
intellectual ability. 

2. The present study confirms the misplacement in terms of difficulty 
level of many of the D-48 items. The test publisher should be urged to 
revise the test booklet so that the serial order of items follows the 
difficulty level found in this study and that reported with other groups 
of subjects. Since the D-48 is a timed test, it is particularly impor- 
tant that the items be arranged in order of difficulty. 

3. The CME may be recommended for use with superior high school students 
although it may not be suitable for the average adolescent in its present 
form. Information given in the present report would be of value in se- 
lecting items that are not too difficult for the average student and 
might form the basis of a revision or an abridgement of this test. 
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4. When the CMT is u< ed with adolescents or adults, the part scores on 
Vocabulary and on Ana ogies should be reported as well as the to al 
score. Further studi* s are needed to verify the present finding of 
greater correlation between Vocabulary and verbal interest than with 
Analogies. The similarity between the D-48 and Analogies should als 
replicated with other types of subjects. 

e Neither of the intelligence tests seem to be grossly affected by 
Liety or i,uWv»e.. a! measured by MMPI scales for the present sub- 
tec tg J The D-48 and the CHI could be used for screening and selection 
purposes without fear that intellectual performance would be seriously 
underestimated because of these two personality characteristics. I 
recommended that the remaining scales of the MMPI and of *e Ad je 
Check List be correlated on an exploratory basis for the present sub 
jects to determine the influence that other personality characteristics 

may have. 

6. Since two vocational interest scales showed significantcorrelations 
with the CMI, although not with the D-48, it would help clarify t h r 
lationship of interest and intelligence to correlate all of the remain 
inn Strong VIB scales with the two intelligence tests for the present 
subjects'!* Results from a correlational analysis might suggest additional 

subgroups for detailed study. 
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Subjects: 1163 gifted adolescents in a special summer program. 

Measures: i ntelligence --D-48 (timej, non-verbal), Terman Concept Mastery 

(untimed, verbal)- MMP1 A scale; imp ulsiv 1 ty- *MMPI Pd 

and Ma scales; ver»a> mi e rest--Strong VIB Lawyer and Author- 
Journalist scales; car eles s ness --errors on "easy" intelligence 
i terns . 

Results: significant correlations --anxiety and intelligence, negative; 

impul sivi l:y and intelligence, negative; verbal interest and 
verbal intelligence, positive; non-verbal and verbal intelli- 
gence, positive; carelessness and intelligence, negative. 



Additional findings: 



Adjective Checx List Counseling Readiness positively 
correlated with intelligence. D-48 more similar ic 
Concept Mastery analogies than to vocabulary. 




